Stability borders of feedback control of delayed measured systems 
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When stabilization of unstable periodic orbits or fixed points by the method given by Ott, Grebogi 
and Yorke (OGY) has to be based on a measurement delayed by r orbit lengths, the performance 
of unmodified OGY method is expected to decline. For experimental considerations, it is desired to 
know the range of stability with minimal knowledge of the system. We find that unmodified OGY 
control fails beyond a maximal Ljapunov number of A max = 1+ -. In this paper the area of stability 
is investigated both for OGY control of known fixed points and for difference control of unknown or 
inaccurately known fixed points. An estimated value of the control gain is given. Finally we outline 
what extensions have to be considered if one wants to stabilize fixed points with Ljapunov numbers 
above A max . 



I. INTRODUCTION 

The appearence of delay is a common problem in the 
control of chaotic systems. The effective delay time in 
any feedback loop is the sum of at least three delay times, 
the time of measurement, the time to compute the ap- 
propriate control amplitude, and the response time of the 
system to the applied control. If the applied control ad- 
ditionally has to propagate through the system [l| , these 
response time may extend to one or more cycle lengths. 

In this paper we investigate time-discrete systems and 
focus on the question what limitations occur if one ap- 
plies the control method given by Ott, Grebogi and Yorke 
(OGY) @ or difference feedback [3j in the presence of 
time delay. 

Stabilization of chaotic systems by small perturbations 
in system variables Q or control parameters [2j has be- 
come a widely discussed topic with applications in a 
broad area from technical to biological systems. The 
OGY method given by Ott, Grebogi and Yorke [2j sta- 
bilizes unstable fixed points (or unstableperiodic orbits 
utilizing a Poincare surface of section 0) by feedback 
that is applied in vicinity of the fixed point x* of a dis- 
crete dynamics x t +\ = f(xt,r). The amplitude of the 
feedback r% = r — tq added to the control parameter ro is 
proportional (with some user-adjustable parameter e de- 
termining the strength of control) to the distance x — x* 
from the fixed point, 



r t = e(x t - x*), 



(1) 



x- ,r 



and the feedback gain can be determined from a lin- 
earization around the fixed point: Neglecting higher or- 
der terms, we have 

fdf 

f(x t ,r + r t ) = f{x*,r ) + {x t -x*)- I — 

Ml,. 

= f{x*,r ) + X(x t -x*)+fir t 

= f(x*,r ) + (\ + »e)-(x t -x*) (2) 

where the Taylor coefficients A and /i are fixed values for 
each orbit. The second expression vanishes for e = —X/fj,, 



that is, in linear approximation the system arrives exactly 
at the fixed point in the next time step, Xt+\ = x*. 

As the uncontrolled system at hand is assumed to be 
unstable in the fixed point, we generally have the situa- 
tion |A| > 1. The system with applied control is stable, in 
linear approximation, if the absolute value of the eigen- 
values of the iterated map is smaller than one, 



\x t +x 



'\ = | (A + Ate) • (x t -x*)\ < \x t 



(3) 



i. e. |(A + /xe)| < 1. Therefore e has to be chosen between 
( — 1 —X)/n and (+1 — A)//i, and this interval is of width 
2//x and independent of A. For OGY control the range 
in A that can be controlled remarkably is not bounded, 
which will appear to be different for delayed measurement 
(see next section). 

It should be mentioned that the stabiliy analysis of the 
one-dimensional case holds also for higher-dimensional 
systems provided there is only one unstable direction. 
One can transform on the eigensystem of the Jacobi 
matrix ^ and finds again the equations of the one- 
dimensional case, reflecting that one only needs to apply 
control in the unstable direction (see e.g. 0,0)- 



II. DELAYED CONTROL OF ITERATED MAPS 

We want to know what limitations occur if the OGY 
rule is applied without modification. In OGY control, 
the control parameter r t is time-dependent, and without 
loss of generality we assume that x* = and that r t = 
if no control is applied. For simplicity, we discuss the case 
t = 1 first. For one time step delay, instead of r t — ex t 
we have the proportional feedback rule: 



r t = ex t -\. 



(4) 



Using the time-delayed coordinates (xt,xt-i), the lin- 
earized dynamics of the system with applied control is 
given by 



Xt+l 

x t 



A fie 
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Xt-l 



(5) 
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The eigenvalues of ( ^ ^ are given by ai_2 = -| ± 

J ^j- + Efj., Hence control can be achieved with e being 
in an interval ] — (1 — A)///[ with the width (2 — A)/ ^. 

In contrast to the not-delayed case, we have a require- 
ment A < 2 for the Lyapunov number, i. e. the direct 
application of the OGY method fails for systems with 
a Lyapunov number of 2 and higher. This limitation is 
caused by the additional degree of freedom introduced in 
the system due to the time delay. 

Now we consider the general case. If the system is mea- 
sured delayed by r steps, r t — ext- T , we write the dy- 
namics in delayed coordinates (xt, Xt-i, Xt-2, ■ ■ -Xt^ T ) T '- 
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The characteristic polynomial is given by (we define 
rescaled coordinates a :— a/X and e = e/i/A r+1 ) 



or 



= P(a) = {a- X)a T - e/x 
= P{a) = (5 - l)a T - e. 



(6) 




FIG. 1: Control intervals for several time delays t — ... 5: 
The plots show the maximal absolute value of the eigenvalues 
as a function of the rescaled control gain e. Values of |<5| = 
1/A correspond to \a\ — 1 in JSJ without rescaling, so one 
can obtain the range ]e_, e+[ for which control is successfully 
acheived. 



the control interval vanishes, and for A > A max (r) no 
control is possible. Equation J2J and the subsequently 
derived stability diagrams are the main result of this pa- 
per and are transferred to difference control in section HVI 
If we look at the Lyapunov exponent A := In A instead 
of the Lyapunov number, we find with In a; < (x — 1) the 
inequality 



r < 1. 



(8) 



Therefore, delay time and Lyapunov exponent limit each 
other if the system is to be controlled. This is consistent 
with the loss of knowledge in the system by exponential 
separation of trajectories. 



III. STABILITY DIAGRAMS BY THE JURY 
CRITERION 



For small r one can derive easily the borders of the 
stability area with help of the Jury criterion Q (see Ap- 
pendix^). For t = 1, the Jury coefficients are given by 
cti = — A/(l + /ie) and a-i = —fA£, and for r = 2 to r = 4 
the corresponding expressions are shown in Appendix 151 

The equations on = ±1 can, although the characteris- 
tic polynomial iJBJ itself is of degree 5, be solved for one 
variable (giving large expressions). The complete set of 
lines is shown in Figure [21 for r = 4 and illustrates the 
redundancy of the inequalities generated by the Jury ta- 
ble. Only four (three for r = 1) of the 2n inequalities 
constitute the border of stability, and unfortunately it 
seems one has to select them by hand. Control is only 
necessary for |A| > 1, and folding the relevant stability 
area into the same quadrant gives Fig. [3] showing how 
Amax decreases for increasing r. 




Fig. ^ shows the maximum of the absolute value of the 
eigenvalues, for t = 0, 1, . . . , 5. In rescaled coordinates 
a = 1/A corresponds to a control interval e±(r, A). For 



FIG. 2: Complete Jury diagram for r = 4 (see Appendix IrH . 
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FIG. 3: Stability areas for r = 1, 2, 3, 4, combined. Only for 
A | > 1 control is necessary (dashed line), and the stability 
area (shaded for r = 4) extends to |A max | = 2, 3/2, 4/3, 5/4. 
Note that still both positive and negative A can be controlled. 
The abscissa — ^(sgnA)^ -1 ' takes into account that for odd 
r a negative /ie is required, independent of the sign of A. 
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in delayed coordinates (xt, Xt-i, ■ ■ ■ Xt- T -i), and the 
characteristic polynomial is given by 



= (a - A)a T+i + (1 - <*)£//. 



(9) 



As we have to use Xt- T -i in addition to x t - T , the system 
is of dimension r + 2, and the lower bound of Lyapunov 
numbers that can be controlled are found to be 



A;, 



2r 



1 



1 



1 + 2t \~ ' t+1/2 
and the asymptotic control amplitude at this point is 

(-iy 



(10) 



Efi = 



l + 2r 



(11) 



IV. STABILIZING UNKNOWN FIXED POINTS 



As the OGY approach discussed above requires the 
knowledge of the position of the fixed point, one may wish 
to stabilize purely by feeding back differences of the sys- 
tem variable at different times. This becomes relevant in 
the case of parameter drifts [T(i| which often can occur in 
experimental situations. A time-continous strategy has 
been introduced by Pyragas [Til], and the time-discrete 
counterpart (i.e. control amplitudes are calculated ev- 
ery Poincare section) is defined by the difference control 
scheme Q . For control without delay, a simple difference 
control strategy 0, S @ is possible for E[i = —A/3, and 
eigenvalues of modulus smaller than unity of the matrix 

^ \ ^ are obtained only for —3 < A < +1, so 

this method stabilizes only for oscillatory repulsive fixed 
points with -3 < A < -1 HH@. 
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FIG. 4: Difference feedback for r = 0, 1, 2, 3: Stability bor- 
ders derived by the Jury criterion (see Appendix |CJ . The 
stability diagram of the non-delayed case r — has already 
been given in ||. From A = — 1 (dashed line) to A = +1 
the system ist stable without control. For each r, control is 
effective only within the respective area (shaded for r = 3). 



We can proceed in a similar fashion as for OGY control. 
In the presence of r steps delay the linearized dynamics 
of a simple difference feedback rt = e(xt- T — ^t-r-i) is 



The stability area in the (jis, A) plane is bounded by 
the lines on = ±1 where ai are the coefficients given by 
the Jury criterion (see Appendix lA"|l . For r — 0, the 
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Jury coefficients are a\ = — ppfjf and a 2 = sfi. For r = 1 
to t = 3, the Jury coefficients are shown in Appendix IU1 

The controllable range is smaller than for the unmod- 
ified OGY method, and is restricted to oscillatory repul- 
sive fixed points with Aj n f < A < — 1. A striking observa- 
tion is that inserting r + | for r in eq. J7J) exactly leads 
to the expression in eq. (|1(J|) which reflects the fact that 
the difference feedback control can be interpreted as a 
discrete first derivative, taken at time t — (r + h). Thus 
the controllability relation © holds again. 

As A -1 is implying a natural time scale (that of ex- 
ponential separation) of an orbit, it is quite natural that 
control becomes delimited by a border proportional to a 
product of A and a feedback delay time. Already with- 
out the additional difficulty of a measurement delay this 
is expected to appear for any control scheme that it- 
self is using time-delayed feedback: E.g. the extensions 
of time-discrete control schemes discussed in with 
an inherent Lyapunov number limitation due to mem- 
ory terms, and the experimentally widely appl ied time- 
continuous schemes Pyragas and ETDAS [12L fl5l Il6| . 
Here Pyragas control has the Lyapunov exponent lim- 
itation Ar p < 2 together with the requirement of the 
Floquct multiplier of the uncontrolled orbit having an 
imaginary part of n, meaning that deviations from the 
orbit after one period experience to be flipped around the 
orbit by that angle, which is quite the generic case [l3| . 
This nicely corresponds with the requirement of a nega- 
tive Lyapunov number that appears in difference control. 
A positive Lyapunov number in the time-discrete picture 
corresponds to a zero flip of the time-continuous orbit, 
and is consistently uncontrollable in both schemes. 

Recently, the influence of a control loop latency has 
also been studied for continuous time-delayed feedback 
[l3| by Floquet analysis, obtaining a critical value for 
the measurement delay r, that corresponds to a maximal 
Lyapunov exponent exp(Ai n f) = Ar p = 1 / 2 + t /t > wnere t p 
is the orbit length and matched feedback delay. By the 
log inequality that again translates (for small Ljapunov 
exponents) to our result for the time-discrete difference 
control. An exact coincidence could not be expected, as 
in Pyragas control the feedback difference is computed 
continuously sliding with the motion along the orbit, 
where in difference control it is evaluated within each 
Poincare section. Although the time-continuous case (as 
an a priori infinite-dimensional delay-differential system) 
could exhibit much more complex behaviour, it however 
astonishing that for all three methods, OGY, difference, 
and Pyragas control, the influence of measurement delay 
mainly results in the same limitation of the controllable 
Lyapunov number. 



V. CONCLUSIONS 

Delayed measurement is a generic problem that can 
appear in controlling chaos experiments. In some sit- 
uations it may be technically impossible to extend the 



control method, then one wants to know the stability 
borders with minimal knowledge of the system. 

We have shown that both OGY control and difference 
control cannot control orbits with an arbitrary Lyapunov 
number if there is only delayed knowledge of the system. 
The maximal Lyapunov number up to which an instable 
orbit can be controlled is given by f + - for OGY control 
and 1 + 1/(t + 1/2) for difference control. For small r 
the stability borders can be derived by the Jury criterion, 
so that the range of values for the control gain e can be 
determined from the knowledge of the Taylor coefficients 
A and fj,. If one wants to overcome these limitations, one 
has to modify the control strategy. 

This can be done either by applying control rhythmi- 
cally 0, El 0, El being equivalent in a formal sense to 
controlling the t + 1-fold iterate (for OGY control) resp. 
t + 2-fold iterate (for difference control) of the original 
system 0,0- However, for larger values of t, the required 
values for the control gain grow exponentially with r, be- 
cause the possibility of applying control in the interme- 
diate time steps is not used. 

The otherpossibility to improve control are memory 
methods [EH El El F° r negative A, in the non-delayed 
case t = the stability area can be extended by two 
methods including an averaged resp. decaying memory 
and requiring only one extra parameter [l4| . 

For arbitrary A and delayed measurement, an improved 
control even ensuring all eigenvalues to become zero can 
be acheived by memory methods that take into account 
control amplitudes applied in previous time steps |a, [?J . 

APPENDIX A: THE JURY CRITERION 

The Jury criterion Q gives a sufficient and necessary con- 
dition that all roots of a given polynomial are of mod- 
ulus smaller than unity. Given a polonomial P[x) = 
a n x n + a n ^ix n ~ l + • • • + a\x + do, one applies the itera- 
tive scheme of the Jury table: 

Vo<i<n bi := a n -i 
a n ■= b n /a n 
Vi<.t<„ a"°Y : = a i - a nbi 

giving a n and coefficients a„_i. . .ao for the next itera- 
tion. 

The Jury criterion states that the eigenvalues are of 
modulus smaller than unity if and only if Vi<i< n |a,| < 1. 
The criterion gives 2n (usually partly redundant) in- 
equalities that define hypersurfaces in coefficient space. 
These hypersurfaces are given by algebraic equations; it 
is not necessary to compute the roots of the polonomial. 

Whereas the Jury criterion is extremely helpful for 
small n and for numeric purposes, the hypersurface equa- 
tions become very complex for large n, and one has to 
select the relevant hypersurface equations. Two 
additional necessary conditions ('check- first conditions') 
for stability are (-l) n a n P(-l) > and a n P(+l) > 0. 
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APPENDIX B: JURY COEFFICIENTS FOR UNMODIFIED OGY CONTROL 

For t = 2, the Jury coefficients take the values a 3 = —fie, a 2 = 7 — 77 1 ol\ — 



1 - (fie) 2 ' 1 - {iief + Xns 

and among the crossing points of the six lines given by on — ±1 one finds the maximal Lyapunov number A = ±3/2. 
For r = 3 the Jury coefficients are: 

Xfie A 2 /ie A — X(fie) 

a 4 = -fie, a 3 = —- — a 2 = - ■ - . — , 9 , , 9 . — 7 — rr, a% - 



I -{pie) 2 ' ' -l + 2( A i£) 2 + A 2 (A*e) 2 -(Me) 4 ' -1 + M£ + AV + (^e) 2 - {fie) 3 

For t = 4, the borders given by the Jury coefficients are already described by algebraic equations of higher order: 

Xfie A (f - Xfie - (fie) 2 ) 



a 5 = -fie, «4 = — r^-, ai 



-f + (/ie) 2 ' -f + X fie + X 3 ^e + 2 (fie) 2 + X 2 (fie) 2 - X(fie) 3 - (fie) 4 

X 2 fie A 3 fie 



a3 -I + 2fie 2 + X 2 fie 2 - (fie) 4 ' " 2 -1 + 3 (fie) 2 + 2 A 2 (fie) 2 + A 4 (fie) 2 - 3 (fie) 4 - 2 A 2 (fie) 4 + (fie) 6 
The equations a; = ±1 can, although the polonomial is of degree 5, be solved for one variable, see Fig. [5] 

APPENDIX C: JURY COEFFICIENTS FOR UNMODIFIED DIFFERENCE CONTROL 

t-, -, , t n~ . -w., / (( £ A*) 2 - A)(l - (e«) 2 - (A - l)eu 
For r = 1, the Jury coefficients are a 3 = efi, a 2 = efi(X - 1)(1 - (efi) ) , ai = — - -. — ^5 — -tt- — i — 

(i - (m ) - (em) (x - ly 

For t = 2, the Jury coefficients are 

(-1 + X)efi _ (l-X)efi(X-(efi) 2 ) 



C(4 — efi, a 3 = — — ttj— a 2 



ai = 



I -(efi) 2 z -l + 3(efi) 2 -2X(efi) 2 + X 2 (efi) 2 -(efi) 4 
(l + efi)(-X + (efi) 2 ) 



1 + efi- XefjL + X 2 efi - 2(e/i) 2 + A(e^) 2 - (efi) 3 
For t = 3, the Jury coefficients are 

efi - Xefi (1 - A) efi (A - (efi) 2 ) 



a 5 = efi, = — -5-, a 3 



a-2 



a 1 



-l + (e/i) 2 ' J -l + 3(e A1 ) 2 -2A(e A1 ) 2 + A 2 M 2 -M 4 

(1-A) £M (A-M 2 ) 2 

-1 + 5(e/i) 2 - 4AM 2 + 3A 2 M 2 - 2A 3 (e^) 2 + A 4 (e^) 2 - 3A 2 (e^) 4 + (efi) 6 - 36AM 8 

A - Xefi + X 2 efi - (efi) 2 - X(efi) 2 + (efi) 3 - X(efi) 3 + (efi) 4 
-1 + efi- Xefi + X 2 e/i - X 3 e/i + 3(efi) 2 - 2X(efi) 2 + X 2 (efi) 2 - 2X(efi) 3 - (efi) 4 
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